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A Content-Analysis Method for Studying Psychotherapy’ 


Epwarp J. MurRRAyY 
Yale University 


I. INTRODUCTION 


SYCHOTHERAPY is of considerable in- 
Teens to psychologists today not only 
because of the importance of psychother- 
apy in the treatment of neuroses and 
psychoses but also because psychotherapy 
is a unique source of data about some of 
the most important and elusive processes 
of human behavior. Much is yet to be 
learned, however, about psychotherapy 
itself. In spite of the general descriptions 
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that are available, it is not clear just what 
goes on between a patient and his thera- 
pist. To some extent this is due to the 
complexity and the number of events in 
psychotherapy. In addition, the subjec- 
tivity of the therapist’s report makes eval- 
uation difficult. It is felt that an ob- 
jective method of studying psychotherapy 
would increase our understanding of psy- 
chotherapy and human behavior in gen- 
eral. 

The phenomena of greatest interest in 
psychotherapy are emotional in nature. 
The problem of how to approach these 
phenomena objectively is a difficult one. 
The observable events in psychotherapy 
may be grouped as physiological, gross 
behavioral, and verbal (10,13,23). How- 
ever, it is not clear just how these observ- 
ables are related to the underlying emo- 
tions and to one another. A full under- 
standing of psychotherapy would require 
information on all the observables. ‘The 
present study is aimed at an understand- 
ing of the verbal phenomena in psycho- 
therapy with respect to the underlying 
emotional processes. 

The meaning functions of verbal be- 
havior were selected for study. Although 
there have been interesting studies on 
the grammatical and formal properties of 
the verbal behavior of a patient in psy- 
chotherapy (10), the content of the pa- 
tient’s speech seems more related to the 
major theories of personality. The gen- 
eral method for studying the meaning 
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properties of language is called content 
analysis. The previous use of content an- 
alysis in psychotherapy has been sum- 
marized by Auld and Murray (1). The 
present paper differs from previous work 
in two ways: first, the method was de- 
veloped in a way which was thought to 
be most relevant to an eventual under- 
standing of the underlying emotional 
processes; and second, the method was 
related to the systematic accounts of 
human behavior of psychoanalytic theory 
(5.7) and learning theory (3,11). 

The purpose of the present study is to 
describe the development, reliability, and 
validity of an objective method of study- 
ing psychotherapy. The method is a way 
of obtaining measures of the manifest 
content of the verbal behavior of the 
patient, and also of the therapist, with 
respect to underlying emotional proc- 
esses in terms of psychoanalytic theory 
and learning theory. The method is 
limited to the conscious part of therapy. 
In all but a few specified instances the 
patient’s words were taken at face value. 
Various studies designed to establish the 
reliability of the method will be pre- 
sented. The validity of the method is 
somewhat difficult to establish since there 
is no generally accepted criterion. How- 
ever, the general basis of validity of sci- 
entific measures of this kind is their use- 
fulness in establishing a set of lawful 
relationships (12). It is beyond the scope 
of the present paper to establish the com- 
plete range and limitations of the meas- 
ures which have been developed. Never- 
theless, a number of studies designed to 
demonstrate the usefulness of the method 
will be presented. These will include an 
example of the use of the method in the 
study of a single psychotherapy case 
which has importance in a major theo- 
retical controversy. Furthermore, a study 
demonstrating the use of the technique 


in determining a general relationship in 
a group of psychotherapy cases will be 
described. Finally, an attempt will be 
made to evaluate the usefulness and limi- 
tations of the method on the basis of 
these results and several previously pub- 
lished studies. In addition, comparisons 
of the results of these studies will be 
made with what is already clinically 
known in a general, qualitative way. 


Il. THe Meruop 


A, The Development of the Method 


The preliminary studies done during 
the development of the method will be 
briefly reviewed and then the method as 
it was finally used in the present research 
will be described in detail. 


The first study involving the method has been 
reported in detail in an earlier paper (18). A few 
simple categories were devised to describe the 
events in seventeen consecutive, tape-recorded 
psychotherapy hours with one patient. The pa- 
tient categories were hostility and defenses. Hos- 
tility was loosely defined as the expression of any 
feeling of frustration, resentment, or anger. The 
hostility category was divided into six subcate- 
gories of hostility according to the referent: (a) 
mother, (b) aunt, (c) other people, (d) general 
situations and groups, (e) the therapist, and (f) 
a vague “at home” (referring to one or more 
persons in the patient’s home). The defense 
category was composed of: (a) intellectual defen- 
sive statements which included the patient's 
views on philosophy, science, current events, 
etc., and (b) complaints about a wide variety of 
physical symptoms and discomforts. Everything 
else the patient said was considered irrelevant. 
The unit scored was called a statement. This 
was either a simple sentence or the meaning 
phrase of a more complicated sentence. ‘The tape 
of each hour was played very slowly, and each 
statement was judged either as belonging to one 
of the eight categories or as irrelevant. A reli- 
ability study with three other judges scoring a 
single randomly selected hour showed that the 
categories were defined in a way which was 
explicit enough for teaching other people the 
method with a fair degree of agreement with 
the main scorer, The reliability for the eight 
categories was high for all three scorers. 

The results of this preliminary study showed 
that the number of hostility statements increased 
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during the course of the case and defensive state- 
ments decreased. This was interpreted in the 
following way: if it is assumed that in this case 
hostility was inhibited by anxiety and the de- 
fensive statements were motivated by anxiety, 
then it would seem that during therapy the 
patient’s anxiety decreased and permitted the 
expression of hostility. The results also showed 
that the intellectual and physical complaint de- 
fenses operated as alternative members of a de- 
fensive hierarchy. There was also some sugges- 
tion that when anxiety is increased in the later 
stages of therapy, previously uninterpreted (or 
unpunished) defenses have a greater probability 
of occurrence than do interpreted (or punished) 
defenses. 

The content-analysis results of the preliminary 
study also showed a phenomenon which seemed 
to be related to displacement (15, 16, 17, 18). The 
patient first expressed hostility about his mother, 
then about his aunt, and, finally, about other 
people. This is contrary to the expectation that a 
patient will first express hostility about the 
less significant and less anxiety-arousing figures 
in his life and then proceed to the more im- 
portant people such as his mother. But on the 
basis of the content-analysis data, the hypothesis 
was formulated that a person would first ap- 
proach the primary and most significant goal in 
a given situation and would displace to less 
significant but similar goals only as anxiety 
about approaching the primary goal increased. 
This hypothesis was tested and verified in an 
animal experiment done in collaboration with 
M. M. Berkun and reported on in detail in a 
previous paper (21). Briefly, in this experiment 
hungry rats were trained to run down a white 
alley to get to a food box. A conflict was estab- 
lished by shocking the rats at the food box. After 
this the rats would only go part way down the 
alley. However, at this point they climbed out 
of the white alley into an adjacent gray alley 
which they had previously ignored. In the gray 
alley they went farther down toward a similar 
goal and then climbed into an adjacent black 
alley. In the black alley most of the rats went 
all of the way down to the food box. This 
experiment has meen mentioned in order to 
show that data on psychotherapy obtained with 
the content-analysis method can influence the- 
oretical thought and lead to controlled experi- 
mentation, 

The results of the content analysis were mean- 
ingful enough and stimulating enough to en- 
courage further development of the method. The 
task of developing a more detailed set of cate- 
gories was begun on a series of tape recordings 
of psychotherapy hours. Immediately a difficulty 
became apparent: the judges were not rating 
the same number of units. This made compari- 
sons of content scoring difficult and impeded the 
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development of the categories. Therefore, it was 
decided to separate the tasks of unit scoring and 
content scoring. In order to do this typescripts 
of the hours were used. A special study was made 
to define the unit and train one person to do 
all the unit scoring in advance. (This is described 
in the next section.) The content scoring was 
then done by listening to the tape recording and 
using the typescripts to locate the unit. 

The advantage of a set of categories over a 
single measure was emphasized at this point in 
the development of the method by a study done 
in collaboration with F. Auld and Alice White 
which has been published (20). In this study, a 
comparison was made between the Discomfort 
Relief Quotient and the present content-analysis 
method. The DRQ consists of the number of 
discomfort units over the number of discomfort 
plus relief units (2). Thus, the DRQ gives a 
measure of verbal tension and may be considered 
the simplest form of content analysis. In the 
case studied in the paper, the DRQ showed no 
change throughout therapy and seemed to indi- 
cate no progress. On the other hand, the con- 
tent analysis showed a dramatic shift from a de- 
fensive cover story about the patient’s mother 
stealing the patient’s children to a discussion 
of conflicts with the patient’s husband. Further- 
more, the discussion of conflicts with the hus- 
band showed a shift from a minor hostility con- 
flict about going to parties, vacation plans, etc., 
to a major sexual conflict. All of these significant 
changes were missed by the single dimension of 
the DRQ. The results of the content analysis 
were in line with a qualitative, clinical analysis 
of the same case by Dollard, Auld, and White (4). 

Therefore, in order to develop a method 
which would adequately describe what was going 
on in therapy it seemed necessary to devise and 
define reliably a detailed set of categories. The 
categories eventually used were heavily influ- 
enced by theories of psychoanalysis and learning. 
In addition, a considerable amount of time was 
spent reading psychoanalytic descriptions of case 
material and the available verbatim scripts of 
psychotherapy interviews. This period in the 
development of the method was characterized by 
a great deal of trial and errror. Finally, a work- 
able set of categories for both the therapist and 
patient were derived. The task of showing their 
reliability and validity is the purpose of the 
research reported in the following pages. There 
is no implication that the task has been fully 
completed nor that the development of the 
method has ceased. 


B. The Unit of Patient Content 


The purpose of this part of the study 
was to establish a set of rules for deter- 
mining patient response units which 
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would be teachable and highly reliable. 
A by-product of the study was that one 
highly reliable unit determiner, other 
than the writer, was available to unit- 
score typewritten hours in advance of 
content analysis. This eliminated any 
bias on the part of the writer and other 
content judges to find more units of one 
content category than another, or to find 
more units of a particular category at 
one stage of therapy than another. 

The unit used was the statement or 
meaning phrase. The rules defining this 
unit appear in Appendix B. A unit 
similar to this has been used in work on 
the Discomfort Relief Quotient. Dollard 
and Mowrer (2) compared the reliability 
of the DRQ when three different units 
were used. A “thought clause” unit gave 
an intercorrelation of +.88 with 10 
judges. However, the question arises, 
how reliable is the determination of the 
“thought clause” unit? Dollard and 
Mowrer found that the intercorrelation 
of 18 scorers for the number of units per 
page was only + .64. The absolute values 
ranged from 50 to 80 units on an average 
page. Although this had little effect on 
the DRQ, it would in all probability dis- 
tort a more complicated set of categories. 
Seeman (24) used a unit which seems to 
be similar to the one proposed here. He 
found an average agreement among four 
judges of 95°, when such units of con- 
tent were counted, and 81°% when such 
units of attitudes were counted. It can be 
concluded from these studies that a unit 
like the statement is feasible. 

The procedure in this study was as 
follows: Six typewritten hours from a 
patient seen 21 times were available. 
‘These had been randomly selected for 
typing. The six were then arranged in a 
random order. A set of rules for unit 
scoring was devised and applied to the 
first two hours by the writer. The me- 


chanics consisted in simply making a 
stroke after each string of words judged 
to be a unit. The rules were then taught 
to a social worker who was naive as far 
as this study was concerned. Hour 1 was 
used for teaching examples. The judge 
then scored Hour 2 independently and 
the results were compared with the 
writer’s scoring. Discrepancies were dis- 
cussed and the rules clarified. Then the 
judge and the writer scored Hour g in- 
dependently and compared results. This 
was repeated for Hours 4, 5, and 6. In 
this way the rules were made more ex- 
plicit and general, while personal tenden- 
cies to make errors, overlook certain 
things, and introduce unverbalized rules 
were reduced. 

The results are presented in Table 1. 
It can be seen that in the vast majority 
of cases both the judge and the writer 


TABLE 1 


THE SCORING OF PATIENT-CONTENT UNITS 
IN THERAPY Hours By Two JUDGES 


No. of units a given 
set of words was di- 
vided into by— 


Hours 


Judge Judge 
A B 


I 
Other discrepancies 7 6 


Total instances 


573 576 475 


No. of exact agree- 
ments + Total no. of 
instances .03 .92 .04 


Total units, Judge A 
Total units, Judge B 


586 579 
633 601 


488 


600 491 


* To be read: There was 1 instance, in material 
obtained in the 5th hour of tape-recording, where 
Judge A counted a given set of words as 1 unit 
and Judge B counted the same set of words as 5 
units, 


5 
3 3 3 2 
2 14 42 19 16 12 
I 412 523 532 527 446 
I 40 7 6 23 6 
I 2 - 2 
471 579 
485 
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scored precisely the same string of words 
as a unit. This agreement was high in 
the beginning but improved with prac- 
tice and discussion. The bulk of the dis- 
crepancies consisted in one scorer’s divid- 
ing a given string of words into two or 
three units while the other considered it 
just one unit. Thus there were few dis- 
crepancies where there was no corre- 
spondence between the units. An analysis 
of the discrepancies shows no tendency 
for making discrepancies with one kind 
of content such as hostility or physical 
complaints. Rather, most of the discrep- 
ancies were due to one grammatical type: 
the relational sentence. The “other dis- 
crepancies” consisted of (a) a word or 
phrase put with the preceding sentence 
by one and with the following sentence 
by the other; (b) phrases considered un- 
scorable by one but scored by the other; 
(c) a string of words divided into three 
units by one and two by the other; (d) 
minor discrepancies. Discrepancies of all 
types decreased considerably by the sixth 
hour. The last line on Table 1 shows the 
total number of units scored by the judge 
and the writer. It can be seen that the 
totals became closer as the training went 
on. 

The reliability of this method seems 
intuitively high. Yet it is a little difficult 
to express the agreement statistically 
since there is no total number of units 
known beforehand. However, one way 
of treating the results is to assume that 
strokes could be put after every word. 
One may then determine the number of 
words after which both scorers put 
strokes, the number after which only A 
put a stroke, the number after which 
only B put a stroke, and the number 
after which neither put a stroke. This 
was done for Hour 6. The resulting 
22 table yields a phi coefficient of 
+ .96. The chi square associated with this 
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5 
is 4155, which is decidedly beyond the 
.001 level. 


C. The Patient-Statement Categories 


The system of patient-content cate- 
gories was based on the concepts of mo- 
tivation and conflict. ‘The method at- 
tempted to order the content of the 
patient’s speech so that it would be rele- 
vant to an eventual understanding of 
the underlying drives of the patient 
without assuming that the relationship 
is necessarily a simple one. There is no 
doubt, for example, that a patient may 
express a drive for sex when it is really 
his dependency needs that he wants satis- 
fied. However, before making such an 
interpretation it would seem desirable to 
have an objective record of the patient's 
expressed needs. Therefore, the system 
was defined in terms of manifest moti- 
vations. 

Four main drives were considered in 
the system of categories: sex, affection, 
dependence, and independence. Sex re- 
ferred to all erotic needs including sexual 
play, intercourse, masturbation, and per- 
versions. It also referred to sexual curi- 
osity and interest, as well as bodily 
functions related to sex. Affection re- 
ferred to needs for love, human warmth, 
friendship, acceptance, etc. Dependence 
referred to needs to be taken care of, 
helped, nurtured, etc. Independence in- 
cluded needs to ‘be independent, self- 
assertive, mature, successful, and com- 
petitive. This independence category 
was perhaps too broadly defined. State- 
ments by the patient which referred to 
drives not included under sex, affection, 
dependence, or independence, and _pa- 
tient statements in which the drive in- 
volved was not clearly specified were 
grouped together in an unspecified drive 
category. However, in a few cases a spe- 
cial drive category, such as hunger need 
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and maternal need, was set up because of 
the high frequency of statements in that 
area by a particular patient. 

Statements by the patient were first 
put into one of the drive categories and 
then put into one of three subcategories 
under each drive. These three subcate- 
gories were defined according to whether 
the patient was: 1, simply expressing a 
need, describing past gratifications of 
that need, and making plans for the 
future gratification of that need, or eg, 
describing a partial or complete blocking 
of that need by internal factors such as 
anxiety, fear, and guilt, or 3, complain- 
ing about and getting angry about frus- 
tration of that drive by external, environ- 
mental factors. These were referred to as 
the three components of a drive: ap- 
proach, anxiety, and frustration. “I en- 
joyed intercourse with my wife last 
night,” is an example of sex approach. 
“I get so frightened when I go to bed 
with a girl that I’m impotent,” is an 
example of sex anxiety. “I get no satis- 
faction because she’s so frigid,” is an 
example of sex frustration. Anxiety was 
usually thought of as being in conflict 
with the approach component of a drive. 
The frustration category included most 
of the hostile and complaining material 
expressed by the patient. 

The anxiety component of each drive 
was originally subdivided into four parts: 
anxiety, negative to the self (feelings of 
inadequacy, etc.), physical symptoms, and 
guilt about hostility related to the drive. 
‘These four parts proved to be easily con- 
fused and separately unreliable. There- 
fore, they were combined. However, it 
may be that in the future these various 
aspects of anxiety may be reliably and 
profitably distinguished. 

Several special categories were used in 
all cases. These were: disturbances of free 
association, simple agreement with the 


therapist, simple disagreement with the 
therapist, intellectual defenses, and gen- 
eralized anxiety. Physical complaints and 
symptoms were included in the general- 
ized anxiety category because they proved 
to be low in frequency and also difficult 
to distinguish from generalized anxiety. 

Each statement, in addition to being 
placed in a content category, was rated as 
to the referent, e.g., self, mother, uncle, 
therapist, etc. The reliability for these 
judgments was extremely high in all 
cases. See Section IV for the reliability 
of statements related to the therapist. 

The various categories may be com- 
bined for various purposes of analysis 
since they were defined in such a way as 
to be comparable. Thus, sex frustration, 
affection frustration, dependence frustra- 
tion, independence frustration, and 
drive-unspecified frustration may be 
combined to give an over-all measure of 
frustration. The definitions and exam- 
ples of all the categories are presented 
in Appendix C. 

In order to test the reliability of the 
set of categories, the following procedure 
was used: A sophisticated psychologist 
was trained on about ten psychotherapy 
hours which had been previously scored 
by the writer. Conferences were held 
after each hour was scored and discrepan- 
cies were discussed. The reliability per- 
son then scored 15 psychotherapy hours 
independently and the hourly totals in 
each category were compared. The 
hourly totals were the appropriate meas- 
ures for comparison since the results to 
be presented in Section III and IV are 
in terms of hourly totals. Therefore, the 
reliability is in terms of data pooled for 
the hour and not in terms of exact agree- 
ment between judgments of individual 
patient statements. The sample of 15 
psychotherapy hours consisted of 8 
randomly selected hours from Case F, 
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3 randomly selected hours from Case F, 
and the four even hours from Case B. 
These cases are described in Section IV. 
Only the first 300 patient units were 
scored in each hour in order to cut 
down the size of the task and permit a 
greater number of hours to be scored. 
Three hundred units comprised roughly 
three-fourths of each hour and seemed 
representative of the whole hour. ‘These 
hours were randomly coded within each 
case so that the scorer was not influenced 
in his judgments by a knowledge of the 
position of the hour in the case. This 
coding procedure was followed in all of 
the scoring by the writer as well. ‘The re- 
liability person scored the hours while 
simultaneously listening to the tape re- 
cording and reading the pre-unit-scored 
verbatim typescripts. 

‘Table 2 shows correlations based on 15 
hourly totals (df = 13) for the basic cate- 


TABLE 2 


THE RELIABILITY BETWEEN Two JUDGES OF THE 
Basic PATIENT-CONTENT CATEGORIES 
BASED ON FIFTEEN HourLy Toras 


Category 
Drive component—all drives: 
Approach 
Anxiety 
Frustration 


Drive—all components: 
Affection 
Dependence 
Independence 
Other or unspecified 


Special categories: 
Disturbance of free association 
Agree therapist 
Disagree therapist 
Intellectual defenses 
Generalized anxiety 


* r, in this table and following tables, stands for 
the Pearson Correlation Coefficient. 

** », in this table and following tables, stands 
for the probability that the corresponding corre- 
lation coefficient is greater than zero. Unless oth- 
erwise stated this value is for both tails of the 
probability distribution. 
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gories. Approach, anxiety, and frustra- 
tion each refer to a summation of these 
components for all drives. Sex, affection, 
etc., refer to a summation of the com- 
ponents of each drive. It can be seen that 
the correlation coefhcients are moder- 
ately large and highly significant. How- 
ever, the correlations account for only 
66% of the variance on the average. 


TABLE 3 
THe RELIABILITY BETWEEN Two JUpGEs or Pa- 
TIENT-CONTENT SUBCATEGORIES BASED 
ON FIFTEEN Hourty 


Subcategory 
Sex approach 
Sex anxiety 
Sex frustration 


Affection approach 
Affection anxiety 
Affection frustration 


Dependence approach 
Dependence anxiety 
Dependence frustration 


Independence approach 
Independence anxiety 
Independence frustration 


Other or unspecified anxiety 
Other or unspecified frustration 


Thus, there is still considerable room for 
improving the definitions of the cate- 
gories and the method of teaching them. 
The reliability of the subcategories for 
each drive is shown in Table 3. Two of 
the subcategories, Dependence-Frustra- 
tion Independence-Frustration, 
showed little interjudge agreement and 
were excluded from general use. ‘The 
other subcategories have moderately 
large, highly significant correlations. On 
the average, these correlations account 
for 62°% of the variance. In general, the 
reliability of the patient-content cate- 
gories seems adequate although not ex- 
tremely high. 


= = 
p 
-94 .OO1 
.63  .02 
-69 
+95 
-84 
.Or ns 
ms 
-88 .oo1 
-94 
) 
7 
.81  .001 
-86  .0o1 
“SS .O5 
.69 .O1 
-92 
-g8 
.86 
.82 
-QI 
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D. The Therapist-Remarks Categories 


While the main interest in developing 
the method was in the patient-content 
categories, it was thought desirable to 
devise at least a preliminary set of cate- 
gories for therapist remarks, so that 
something would be known about the 
stimuli presented to the patient. A simple 
unit was selected for this purpose: every- 
thing a therapist said in between patient 
statements. However, there were a few 
cases where therapists and patients in- 
terrupted one another and in these in- 
stances the entire remark of the therapist 
was considered one unit. 

The therapists’ remarks were grouped 
into two general classes: active and pas- 
sive remarks. The active remarks  in- 
cluded all clearly interpretative, evalua- 
tive, and manipulative responses. The 
subcategories of active remarks consisted 
of: instructions to free associate, labels, 
discriminations, similarities, strong ap- 
provals, demands, and directions. ‘These 
subcategories were drawn from the learn- 
ing theory analysis of psychotherapy by 
Dollard and Miller (3) and from the ex- 
amination of verbatim typescripts. The 
subcategories are defined along with 
examples in Appendix D. 

Passive therapist remarks refer to those 
remarks which are primarily designed to 
acknowledge that the patient is talking. 
The subcategories consisted of: mild 
probings, mild approvals, and “Mm.” 
These are also defined in Appendix D. 
All other therapist remarks were scored 
as irrelevant. 

A preliminary study showed that with 
training even a relatively psychologically 
naive person could score therapist  re- 
marks reliably. However, the main reli- 
ability study was done on the same 
sample of psychotherapy hours (df = 13) 
used for the reliability of the patient- 


content categories. The same psychologist 
scored the therapist remarks as he scored 
the patient statements. 

Active and passive therapist-remarks 
categories had moderately large, highly 
significant reliability coefficients is 
shown in Table 4. These coefficients ac- 
count for an average of 64°, of the 
variance. ‘The subcategories all had sig- 
nificant, although not universally large, 
correlations, except for the subcategory 
of mild probes. This subcategory, of 
course, was not used by itself for any 
analysis of the results. 

Since the total number of therapist 
remarks in any one hour was not pre- 


TABLE 4 
THE RELIABILITY BETWEEN Two JUDGES OF 
THERAPIST-REMARKS CATEGORIES BASED 
ON FIFTEEN Hourty 


Category 


Active therapist remarks: 
Instructions 

Labels 

Strong approvals 
Disapprovals 

Demands 

Directions 


Passive therapist remarks: 
Mild probes 
Mild approvals 
Mm 

Not classifiable 


Total therapist remarks -998 


determined, a comparison of the totals 
shows the reliability of determining 
therapist-remark units. This is highly 
reliable, as is shown in Table 4. 

The subcategories of discrimination 
and similarities had no frequency in the 
reliability sample. Therefore, no correla- 
tion could be computed. ‘These categories 
also had very little frequency in all of the 
cases studied to date. This may be due to 
the fact that relatively short-term cases 
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were used. In a longer, analytic therapy 
case, it would be expected that these 
categories would be more useful. ‘Their 
reliability remains open to question until 
tested. The remaining categories in 
‘Table 4 seem to be sufficiently reliable 
to warrant using them. 


THe Use or tHe MeEetTHop 
IN A CASE STUDY 


A. The Effect of Subtle Directitveness in 

Psychotherapy 

The use of the content-analysis method 
in a case study will be illustrated by an 
analysis of the effects of subtle directive- 
ness by a therapist on changes in the 
verbal behavior of his psychotherapy pa- 
tient. From the point of view of learning 
theory (3, 11) it would be expected that 
mild approval and disapproval by the 
therapist would be an effective method of 
subtly directing a patient. It would be 
anticipated that patient categories which 
contained statements which fol- 
lowed by therapist remarks having mild 
approval value would show an increase 
in frequency during the course of psycho- 
therapy. On the other hand, it would 
be expected that patient categories which 
contained statements which were fol- 
lowed by mild disapproval by the thera- 
pist would show a decrease in frequency 
during the course of psychotherapy. 

The case studied was that of Herbert 
Bryan, which was printed verbatim in a 
book by Carl R. Rogers (22). This case 
is a good one for studying the effects of 
subtle directiveness in psychotherapy be- 
cause the patient was treated by the 
client-centered technique. The philos- 
ophy behind this technique is that the 
therapist must recognize the personal in- 
tegrity and capacity for maturity of the 
patient. The client-centered therapist en- 
ables the patient to reach the level of 
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adjustment that the patient himself de- 
sires by being accepting, understanding, 
and permissive (22, 23, 25). The very 
nature of the client-centered technique 
precludes any strong directiveness which, 
if present in the case, would probably 
obscure any possible effects of subtle 
directiveness. On the other hand, a cer- 
tain amount of mild approval and _re- 
Strained interpretation is recognized as 
occurring in client-centered therapy (22, 
23) and accepted as a legitimate part of 
the client-centered technique (25). There- 
fore, since the case would be expected to 
have little or no strong directiveness and 
some mild approval and interpretation, 
it would seem to be an appropriate case 
for studying the effects of subtle directive- 
ness by the therapist on changes in the 
verbal behavior of the patient. 


B. Method 


The content-analysis method described 
in Section II and Appendices B, C, and D 
was applied to the eight therapy hours 
printed in Counseling and Psychotherapy 
(22). The categories used in this study 
are briefly described as follows: The 
category of sex contained statements 
about sexual attraction to the mother, 
hostility to the mother for punishing the 
patient for talking about sex, etc.; sexual 
feelings towards various girl friends; ex- 
pressions of feeling feminine in a voyeur- 
istic situation, jealousy of boy friends 
who leave him for girls, and other homo- 
sexual expressions requiring a minimum 
of interpretation. Intellectual defenses 
consisted of philosophical discussion and 
extremely abstract speculation. General 
anxiety included statements of tension, 
conflict blocking, and physical sensations 
of various kinds. Independence involved 
several subcategories of going ahead in 
business, general assertiveness, freedom 
from the therapist, etc. Independence 
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TABLE 5 


THe RELIABILITY BETWEEN Two JUDGES OF THE 
ConTENT CateGories Usep IN THIS STUDY 
BasEeD ON Four Hovurry Totats 


Category 


Independence 

Independence anxiety 

Intellectual defenses 
Il sex 

General anxiety 


anxiety was the expression of fear and 
guilt about independent and assertive 
actions. 

Table 5 shows the reliability of the 
categories used in this study. One clinical 
psychologist was trained on the four odd- 
numbered hours in the case and then his 
agreement with the writer determined on 
the remaining four hours. The reliability 
for each category was based on the total 
number of units judged in that category 
in the first three hundred patient units 
in each of the four hours (df = 2). The 
reliability was good for all categories ex- 
cept intellectual defenses. The intellec- 
tual defense category was retained on a 
highly tentative basis in this study in 
spite of the fact that it did not reach 


significance for two reasons: 1, the re- 
liability scorer agreed with the writer 
on a general downward trend and 2, 
the category was highly reliable in the 
larger reliability study (see Section IT). 

The therapist-remarks categories 
which seemed most relevant to the prob- 
lem were approval and disapproval. All 
other categories were grouped together as 
neither. Table 6 shows the agreement be- 
tween the writer and the same clinical 
psychologist who judged the patient con- 
tent in independently judging therapist 
approval and disapproval related to each 
of the patient categories. The sample 
consisted of all the therapist's remarks 
made during the first 300 patient units 
for each of the four odd-numbered hours. 
This was about 60 therapist remarks on 
each of the hours and added up to a 40% 
sample of all therapist remarks. It can be 
seen that both scorers agreed that inde- 
pendence was approved and never dis- 
approved; that independence anxiety, in- 
tellectual defenses, and sex were disap- 
proved and never approved. There is 
general agreement on the other categories 
well. 


TABLE 6 


A CoMPARISON OF JUDGMENTS OF THERAPIST APPROVAL AND DISAPPROVAL BY Two 
JupGEs, AS RELATED TO ALL PATIENT-CONTENT CATEGORIES 


Patient 
content categories 


First judge 


Approvals 


Disapprovals 


Second judge 


Approvals Disapprovals 


Independence 4 
Independence anxiety 
Dependence 
Dependence anxiety 
Intellectual defenses 
All sex 
General anxiety 
Other: 
Anxiety parents 
Frustration parents 
Positive to self 
Affection therapist 
Disturbance 
Irrelevant 
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C. Results 


The primary problem is whether the 
therapist influenced the verbal behavior 
of the patient during therapy. In order to 
determine this it is necessary first to dem- 
onstrate that the therapist approved and 
disapproved different categories. ‘Table 7 
shows all of the approvals and disap- 
provals found in the case by the writer. 
The same pattern as in Table 6 is im- 
mediately apparent. The therapist ap- 
proved independence and primarily dis- 
approved independence anxiety. Further- 
more, he disapproved dependence and 
approved dependence anxiety. ‘These are 
two different ways of doing the same 
thing. In addition, the therapist disap- 
proved sex and intellectual defenses. 
General anxiety was both approved (in a 
reassuring way) and disapproved (at 
several points where it dominated the 
discussion). ‘he other categories are 
shown in ‘Table 7 to show that few other 


approvals or disapprovals appeared. An 
examination of these categories shows a 
pattern which fits in with the approval 
and disapproval in the major categories. 


TABLE 7 


ALL THERAPIST APPROVALS AND DISAPPROVALS 
FOR ALL RELEVANT PATIENT- 
CONTENT CATEGORIES 


Therapist 
approval 


Therapist 


> 
Patient Category disapproval 


Independence 
Independence anxiety 
Dependence 
Dependence anxiety 
Intellectual defenses 
All sex 

General anxiety 


Other: 
Anxiety parents 
Frustration parents 
Positive to self 
Affection therapist 
Disturbance 
Irrelevant 


Total 
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\ DISAPPROVED APPROVED 
\ CATEGORIES CATEGORIES 


PERCENT OF TOTAL STATEMENTS 


Fic. 1. The effects of approval and disapproval 
by the therapist on the percentage of statements 
in the approved and disapproved patient cate- 
gories during eight hours of psychotherapy. All 
patient categories which were approved are 
pooled and all patient categories which were 
disapproved are pooled in this analysis. 


The next step is to see whether the 
therapist’s pattern of approval and dis- 
approval had an effect on the patient's 
verbal behavior. Figure I shows the per- 
centage of the total number of patient 
statements in each hour which were in 
the categories approved by the therapist 
and in the categories disapproved by the 
therapist. The approved categories in- 
crease as therapy progresses while the 
disapproved categories decrease. 

‘The number of approvals the therapist 
gave on a given hour was highly cor- 
related with the percentage of the re- 
warded categories (r = .97, p < .01). This 
was also true of disapprovals and the 
percentage of the disapproved categories 
(r = 80, p <.05). Therefore, the be- 
havior of the therapist was consistent 
with the appearance of the categories. 

The therapist reacted to the patient’s 
expression of desires to be mature, in- 
dependent, and self-assertive with ap- 
proval on Hours, 1, 3, 4, 5, 6, 7, and 8. 
‘The approvals grew more frequent and 
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stronger as therapy progressed. The fol- 
lowing are examples of the approvals 
by the therapist for independence on 
the part of the patient: 


P—Well, I'd had the idea that there was some 
sort of a secret button that I had overlooked 
and that I would have to touch. I knew that it 
would take motivation and will-power to touch 
it, but I felt that first I had to find it—now I'm 
beginning to have the belief that there is no 
definite button as an ideological concept per se— 
that what it boils down to is looking at your 
present-day life, and saying, “Well, what are 
you going to do about it—which reaction are 
you going to have?” And that that emotional 
resolve which we term the act of will, will relieve 
the negative feelings without any hidden mys- 
tery or anything like that having to be exposed. 

T—That’s what I think, too. 

P—I'm glad to hear that. 

T—Well, there’s no doubt that you are right 
when you first came in that you had a lot to 
say today. 

P—Oh, I knew it. I mean—I know myself 
pretty well; I think I’m pretty honest with 
myself. 

T—And growing increasingly honest, I would 
sav. 

P—M-hm. Yes. I imagine that that’s the true 
function of psychoanalysis, is to—well, to sort 
of force the issues, to make them clear-cut, and 
so that the resolve can take the right direction. 

T—Well, you raised the question last time 
whether I thought you were making progress. I 
guess you wouldn’t have to ask it today (Laugh). 


and, 


P—My work had a setback. The camera needs 
some more repair. It won't be ready till next 
week, but I think I can get ahold of another 
one. I notice I made an effort to locate another 
one, rather than wait till next week, till the 
first one gets fixed. 

T—Do I understand that you really wanted 
to get to work on that? 

P—Yes, I think that that would be the indi- 
cation there. See, I could have waited till next 
Wednesday, until] my own camera gets fixed, but 
I went this afternoon and got one lined up from 
one of the downtown supply houses. 

T—That really means something. 

P—Yes, I thought that it did. I went over and 
talked to the manager quite a lot. It needed a 
good deal in the realm of persuasion there—it 
was a very unusual request. I felt that I talked 
him into completing negotiations so that I won't 
have to wait till next week. 

T—And that makes you feel pretty good, I 
presume? 


MURRAY 


P—Oh, yes. You see, I believe that some weeks 
ago I would have said, ‘Well, I believe I'll wait 
till Wednesday,” and just seized the pretext to 
remain inert, but— 

T—Something makes it different now? 

P—Yes, there is a barrier there, but not an 
insurmountable one. I walked in, anyway, and 
started talking to the manager. (Pause.) 

T—That sounds like quite a step. 


As can be seen in Figure 2, the first effect 
of this behavior of the therapist was to 
raise the anxieties of the patient about 
independence. Some mild disapproval for 
independence anxiety was expressed by 
the therapist on Hours 5 and 6. Then, 
rather suddenly, as shown in the upper 
half of Figure 2, independence increased 
to dominate Hours 7 and 8 and was 
somewhat strongly approved by the ther- 
apist. 

The categories of dependence and de- 
pendence anxiety had very low frequen- 
cies which did not even permit a relia- 


GENERAL 
INDEPENDENCE 
ANXIETY 


PERCENT OF TOTAL STATEMENTS 


3 4 5 6 
PSYCHOTHERAPY HOURS 


Fic. 2. The upper graph shows the percentage 
of statements in the therapist-approved, patient 
categories of independence during eight hours 
of psychotherapy. The arrows indicated the 
hours on which independence was approved by 
the therapist. The lower graph shows the pa- 
tient category of independence anxiety. 
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bility coefficient to be computed. They 
must be regarded as unreliable and are 
therefore not presented. The effects of 
the therapist’s disapproval for depend- 
ence and approval for dependence anx- 
iety (essentially an expression of denying 
dependence) can be thought of as operat- 
ing indirectly on the categories of inde- 
pendence and independence anxiety. Ap- 
proving dependence anxiety is roughly 
equivalent to approving independence. 
Disapproving dependence is roughly 
equivalent to disapproving independence 
anxiety. This situation can be viewed as 
a double approach—avoidance conflict 
(14) with independence and dependence 
as the two goals. 

At the same time that the therapist 
was approving independence, he was 
mildly disapproving intellectual defenses 
and the various sex-categories. During the 
first few hours of therapy the patient dis- 
cussed his problem in extremely abstract 
intellectual terms and frequently lapsed 
into philosophical speculation. ‘The fol- 
lowing excerpts illustrate the therapist's 
reaction to the intellectual defense. 

P—Of course, perhaps that’s too general to be 
of any significance. It wouldn’t—well, it could 
hardly be anything else but a fear, could it? 

T—Well, I think that the more significant 
elements are what you experience, not what you 
think intellectually it might be. I mean, if you 
experience fears in your nightmares—that’s some- 


thing. Any amount of thinking about whether 
or not it might be a fear is... 


and, 


T—And it is going to be a question of—you 
say your feelings are blocking yourself—can you 
look at them? Can you really consider your own 
reactions—not an intellectualized abstracted pic- 
ture of them? 


The tone of these remarks by the thera- 
pist is disapproving. The subsequent de- 
cline in intellectual defenses shown in 
Figure 3 was probably related to this dis- 
approval although it is always possible 
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DISAPPROVED 
INTELLECTUAL 
DEFENCES 


TOTAL STATEMENTS 


PERCENT OF 


PSYCHOTHERAPY HOURS 


Fic. 3. The percentage of statements in the 
disapproved patient category of intellectual de- 
fenses during eight hours of psychotherapy. The 
arrows indicate hours on which intellectualiza- 
tion was disapproved by the therapist. 


that other factors were also operating. 
Incidentally, the reliability scorer who 
disagreed with the author on some of the 
minor fluctuations in the intellectual de- 
fense curve also obtained a result show- 
ing a general decline from the first half 
to the second half of therapy. 

At the beginning of therapy the pa- 
tient felt that his problems were pri- 
marily sexual. The therapist disagreed 
with the patient and at one point said 
that the sexual problems were only lesser 
manifestations of a more fundamental 
problem of self-respect and maturity. 
Many people would agree with the thera- 
pist. However, the therapist’s attitude 
about sex seemed to influence his clarifi- 
cations so as subtly to discourage the 
patient’s dwelling on that topic. The fol- 
lowing excerpt illustrates one of the 
subtle techniques used by the therapist. 

P—I vicariously experience the girl as she 
exhibits to me and get a vicarious sexual en- 
joyment from that, so that I am both the ex- 
hibitor and exhibitee. So what it seems to be is 
that, when my condition becomes worse, I find 


that my man role seems to be blocked, so I 
escape into what we might call a semifeminine 
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role, whereas I adopt vicariously the feminine 
enjoyment of exhibitionism to me. 

T—You feel that is a feminine role, or a more 
childish role, or something of both? 

P—Well, I think the origin came from the 
girl roomers that we had when I was a child, 
whom I am sure got an exhibitionistic enjoyment 
in exhibiting to me. I believe that my reactions 
were probably something like this: my parents 
were inhibiting my own life—my own particular 
pattern—so perhaps I felt that in order to get 
the forbidden enjoyments of sex I would have to 
slip into a feminine role, which was just at the 
same time, you see, presented to me by the 
exhibitionistic girls. So that the temporal juxta- 
position of the two situations, you see—I wanted 
to retreat and escape young masculine activity, 
and searching about for a way to get the tabooed 
sex pleasures, I seized upon a vicarious enjoy- 
ment of the exhibitionistic girls. 

T—Let me see if I get what you're meaning 
there—in other words, when you're faced with 
something—I’m not quite sure whether the 
blocking is that there is something pretty diffi- 
cult in this masculine role, or whether you're 
referring to other kinds of blocking—at any rate, 
when you're blocked in being a man, you tend to 
fall back into a possibly more feminine kind of 
satisfaction—certainly a more childish kind of 
satisfaction in voyeurism. 


It seems likely that this sort of behavior 
on the part of the therapist contributed 


DISAPPROVED 
CATEGORIES 


PERCENT OF TOTAL STATEMENTS 


PSYCHOTHERAPY HOURS 


Fic. 4. The percentage of statements in the 
disapproved patient categories of sex during 
eight hours of psychotherapy. The arrows indi- 
cate hours on which discussion of sex was dis- 
approved by the therapist. 
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PHYSICAL 
SENSATIONS 


PERCENT OF TOTAL STATEMENTS 


PSYCHOTHERAPY HOURS 
Fic. 5. The percentage of statements in the 


patient category of general anxiety and physical 
sensations during eight hours of psychotherapy. 


to the decline of the sex categories shown 
in Figure 4. 

General anxiety and physical com- 
plaints were to a large extent simply ac- 
cepted by the therapist although some 
aspects were very mildly approved and 
some very mildly disapproved. This gen- 
eral anxiety category showed a large tem- 
porary increase on Hours 5 and 6 after 
an initial decline as can be seen in Fig- 
ure 5. Hours 5 and 6 were probably anxi- 
ety-provoking for the patient because it 
was then that the major decision in the 
therapy was discussed. It can also be seen 
in Figure g that the intellectual defenses 
also increased during Hours 5 and 6. In 
a previous paper (18) similar data were 
presented and the hypothesis formulated 
that when anxiety is increased in the 
later stages of therapy all defenses may 
increase but previously disapproved de- 
fenses do not increase as much as defenses 
which have not been disapproved. ‘This 
is what seems to have happened here. By 
Hour 5, intellectual defense and sex cate- 
gories had decreased possibly as a result 
of the disapproval of the therapist. By 
Hour 7 the patient was primarily ex- 
pressing the independence which had 
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been consistently approved by the thera- 
pist. The decision to be independent was 
made between Hours 6 and 7. It would 
seem that the therapist’s pattern of ap- 
proval and disapproval played some role 
in this decision. 


D. Discussion 


The therapist in the case of Mr. Bryan 
seemed to influence the verbal behavior 
of the patient by subtly approving inde- 
pendence and self-assertion and mildly 
disapproving intellectual defenses and 
discussion of sexual problems. The thera- 
pist appeared to play an important role 
in the major decision of the patient. The 
subtle directiveness observed in this case 
does not consist of isolated instances of 
little consequence. The instances of sub- 
tle directiveness combine to form a pat- 
tern which could account for the major 
events in the case. The results are in 
agreement with the learning theory ex- 
pectations and tend to support the use- 
fulness of learning theory in understand- 
ing some of the complex events in psy- 
chotherapy. 

The results of the content analysis 
presented in this chapter are supported 
by two minor studies described in Ap- 
pendix A, which involved other tech- 
niques. In the first study a group of 
clinical psychologists showed high agree- 
ment on the approval or disapproval 
value of selected therapist remarks from 
the case of Herbert Bryan. In the second 
study a group of relatively naive subjects 
read one hour from the case of Herbert 
Bryan and agreed in a questionnaire that 
the therapist subtly got across his prefer- 
ence for the patient’s deciding to become 
independent. 

In the present study, the measure of 
directiveness was relatively crude. There 
are many more subtle forms of direction 
in this case, and in many other cases, 
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which are somewhat difficult to measure. 
For example, the interest or lack of in- 
terest shown by the therapist in an item 
brought up by the patient may have im- 
portant consequences. One way a thera- 
pist can do this is by selectively repeating 
one of the patient’s sentences and ignor- 
ing others. This is used as a technique by 
some therapists for getting at important 
material (3). The therapist can also show 
interest by the selective use of “Mm” 
responses. Greenspoon (g) found that the 
selective use of “Mm” produced an in- 
crease in frequency of classes of words in 
a free association experiment. Finally, 
the therapist may express a very strong 
opinion by the way in which he clarifies 
and formulates a problem and by the 
language he uses. In the present case, the 
therapist formulated the patient’s prob- 
lem as a “choice—between going ahead 
which involves responsibility—or slip- 
ping back into the easier possibility—.” 
Note the use of words with positive 
prestige value in middle class American 
culture such as “going ahead” and “re- 
sponsibility” for one choice in conjunc- 
tion with words having negative prestige 
value like “slipping back” and “easier 
possibility” for the other choice. In a 
middle class patient, such as Mr. Bryan, 
this technique might be rather powerful. 


IV. THe Ust oF THE METHOD IN 
DETERMINING A GENERAL 
RELATIONSHIP 


A. The Patient’s Feelings Toward the 

Therapist 

The feelings that a patient has toward 
the therapist have been considered im- 
portant in psychoanalytic theory for a 
long time (6). Originally the transference 
aspects of the patient’s feelings were em- 
phasized; certain responses by a patient 
to the therapist were thought of as car- 
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ried over from unresolved problems with 
the significant people in his early life. 
‘Today analysts consider all aspects of the 
patient's feelings toward the therapist im- 
portant, whether they are based on trans- 
ference or reality (8). As the therapeutic 
relationship is established, the therapist 
can make the patient aware of his inap- 
propriate reactions and enable him to 
respond _ realistically. In addition, the 
positive feelings toward the therapist are 
thought to keep the patient in therapy 
in the face of anxiety. However, there is 
much that is not known about the thera- 
peutic relationship—especially its devel- 
opment and control. Therefore, this 
would seem to be an appropriate area for 
research. 

The content-analysis method was ap- 
plied to certain aspects of the therapeutic 
relationship in order to investigate the 
general problem of how the manifest at- 
titudes of the patient toward the thera- 
pist change during therapy. The study 
was limited to the verbal expression of 
feelings toward the therapist by the pa- 
tient and the therapist’s verbal reactions 
to this expression. Data were gathered on 
several specific questions: Does the fre- 
quency of the patient’s references to the 
therapist increase as therapy progresses? 
Is there a decrease in the verbal ex- 
pression of negative feelings and an in- 
crease in the expression of positive feel- 
ings toward the therapist as therapy pro- 
gresses? Or is there an increase in the ex- 
pression of all kinds of feelings about the 
therapist? How does the verbal behavior 
of the therapist influence the patient’s 
statements about the therapist? 

It is quite apparent that these ques- 
tions about the therapeutic relationship 
are limited in scope. They barely scratch 
the surface of the complex phenomena 
of the patient-therapist interaction. They 
are confined to several relatively simple 


verbal changes. However, they represent 
the beginning of an inquiry into that 
part of the area in which the content- 
analysis method is most applicable. Care 
will be taken to avoid any undue extra- 
polation from the verbal data obtained 
to the underlying emotional processes. 


B. Method 


A total of 110 psychotherapy hours 
from seven cases were used in this part 
of the study. Cases A, C, EF, F, and G 
were tape recorded and transcribed by 
the Departments of Psychology and Psy- 
chiatry at Yale University. Cases A, EF, 
and F contained 5, 20, and 33 consecutive 
hours. Case C, reported elsewhere (20), 
contained six randomly selected hours 
from a total of 17 psychotherapy hours. 
Case G contained every third consecutive 
hour over a series of 6g hours—making a 
total of 23 hours used. Case D, reported 
in detail elsewhere (18), contained 17 
consecutive tape-recorded but not tran- 
scribed hours. Case B contained 8 con- 
secutive hours printed verbatim in the 
book by Rogers (22). 

The sample is heterogeneous with re- 
spect to the length of therapy, experience 
of the therapist, and theoretical orienta- 
tion of the therapist. The patients were 
all neurotic but had various kinds of 
complaints character structures. 
However, the cases were alike in that 
each consisted of an interaction of two 
people, one of whom came to the other 
for psycvotherapeutic help. 

The patient-content categories used in 
this part of the study were all those re- 
lated to the therapist. The opening-and- 
closing-the-hour salutations and expres- 
sions of difficulty in free associating were 
not included. The reliabilities of the 
categories related to the therapist are 
shown in Table 8. The correlations are 
based on a comparison of the writer and 
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TABLE 8 


Tue RELIABILIT” BETWEEN Two JUDGES OF Pa- 
TIENT-CONTEN Tt CATEGORIES RELATED TO 
THE THERAPIST, BASED ON FIFTEEN 
Hourty Torats 


Category 


All categories pooled 
All positive categories 
All negative categories 
All anxiety categories 
All frustration categories 
All sex categories 

All affection categories 

All dependence categories 
All independence categories 


another psychologist for the first 300 pa- 
tient units in each of 15 psychotherapy 
hours (df = 13). The sample included 8 
randomly selected hours from Case F, 3 
randomly selected hours from Case E, 
and the 4 even-numbered hours from 
Case B. The reliability scorer had been 
trained on the four odd hours from Case 
B and about six other randomly selected 
hours from Case F. The reliability re- 
mains high when the three cases are con- 
sidered separately. The main measure 
used in this part of the study appears in 
Table 8 under the title “all categories 
pooled” and is highly reliable. “All posi- 
tive categories” refers to approach com- 
ponents of sex, affection, dependence, 
and independence (see Section IT). “All 
negative categories” refers to the anxiety 
and frustration components of all the 
drives (see Section II). The frequency of 
statements in the sex categories was too 
low in the reliability sample to permit 
the computation of a correlation. Gen- 
erally, the patient-content categories re- 
lated to the therapist seem to be highly 
reliable. 

Therapist remarks studied here in- 
cluded any response the therapist made 
to a patient statement about the thera- 
pist plus any probing remark the thera- 
pist made about the patient’s feelings 


FOR STUDYING 


PSYCHOTHERAPY 17 


TABLE 9 


THE RELIABILITY BETWEEN Two JUDGES OF 
THERAPIST-REMARKS CATEGORIES RELATED 
TO PATIENT STATEMENTS ABOUT THE 
THERAPIST, BASED ON FIFTEEN 
Torats 


Category 
All therapist remarks 
Active therapist remarks 
Passive therapist remarks 


toward the therapist. Only the major 
categories of therapist remarks—active 
and passive—were used in this part of the 
study (see Section IT). Table g shows the 
reliability of all therapist remarks, active 
remarks, and passive remarks related to 
the patient’s statement about the thera- 
pist. The same reliability scorer and the 
same sample used for the patient content- 
category reliability was used here. ‘The 
reliability seems adequate. 

Cases A, B, E, F, and G were content- 
analyzed by the writer with the detailed 
set of categories described in Section IT. 
The tape recordings were played in a 
completely random and coded order 
while the scorer read the typescript. Case 
B was just read. Cases C and D were con- 
tent-analyzed earlier with a simpler set 
of categories that did not contain the 
present subdivisions. Therefore, these 
two cases will only be used for the over- 
all measure of patient statements related 
to the therapist. 


C. Results 


The percentage of the total number ol 
statements made by a patient in a psycho- 
therapy hour which was related to the 
therapist shows an irregular but definite 
increase during the course of therapy as 
shown in Figure 6. The data were con- 
verted into percentages in order to con- 
trol for variations in the total number 
of statements from hour to hour. ‘Table 
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Fic. 6. The percentage of the total number of patient statements in an hour that was related to the 
therapist during the course of seven psychotherapy cases. 
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TABLE 10 


THE INCREASE IN THE AVERAGE PERCENTAGE OF 
THE TOTAL NUMBER OF PATIENT STATEMENTS 
IN THE Hour WHICH WERE RELATED TO THE 
THERAPIST FROM THE First HALF TO THE 
SeEcoND HALF OF PSYCHOTHERAPY 


Average 
% for 


first half 


Average 
% for 
second half 


& 


Increase 


| 


-9 


10 Shows the increase in the average per- 
centage of the total number of statements 
in the hour which were related to the 
therapist from the first half to the second 
half of therapy for each case. The mean 
average for the group for the first half 
was 5.3% and for the second half 10.9%. 
‘The mean increase of 5.6% was highly 
reliable (p <.o1). A regression line was 
fitted to each case as is shown in Figure 
6. All of the regression lines had a posi- 
tive slope. The probability that all seven 
regression lines would have a_ positive 
slope by chance alone is very low 
(p <.01). 

While it is clear that the general trend 
of patient statements about the therapist 
is to increase as therapy progresses, the 
irregularity of this increase cannot be 
dismissed as error because of the rela- 
tively good reliability of the measure. An 
examination of Figure 6 suggests cyclical 
trends. However, the irregularity may be 
due to a number of unknown important 
variables. 

The mean increase in the average per- 
centage of the total number of statements 
in the hour which were in the individual 
content categories related to the therapist 
from the first half to the second half of 
therapy is shown in Table 11. This table 
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is based on the five cases (A, B, E, F, and 
G) for which such breakdown was avail- 
able. The general impression is that ex- 
pressions of all kinds of feelings toward 
the therapist increase throughout ther- 
apy rather than an increase in positive 
feelings and a decrease in negative feel- 
ings. However, because of the decrease in 
frequency produced by the subcategoriza- 
tion, the increments only approach reli- 
ability. The frequency in the sex and 
dependence categories was extremely low. 
Therefore this result, although sugges- 
tive, is very tentative. 

A question of both theoretical and 
practical importance is what factors are 
related to the increase in the frequency 
of patient statements about the therapist. 
In this connection, the rate of increase in 
the patient statements about the thera- 
pist seems the most appropriate datum. 
The therapist’s verbal behavior would 
be one of many variables expected to be 
related to the rate of increase of patient 
statements about the therapist. ‘The prob- 
lem is just what aspects of the therapist's 
verbal behavior can be measured and 
shown to have a substantial relationship 


TABLE 11 


THE MEAN INCREASE IN THE AVERAGE PERCENT- 
AGE OF THE TOTAL NUMBER OF PATIENT STATE- 
MENTS IN THE HourR WHICH WERE IN THE 
INDIVIDUAL PATIENT-CONTENT CATEGOR- 
1ES RELATED TO THE THERAPIST, FROM 
THE First HALF TO THE SECOND 
HALF OF PSYCHOTHERAPY 


Average 


Category increment 


Anxiety (pooled) 
Frustration (pooled) 
Sex 


Dependence 


I 
2 
Affection 2. 
Independence I 


All positive 
All negative 


All statements 


— — 

4.2 $7 I 
5.6 9-5 3 
3.0 I 
7 
20.0 7 
14.7 9 
6 
Mean 5.2 5 

ns 

fe} 

fe} ns 

fe} ns 

6 ns 
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2.2 

3-9 -10 

5.6 
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with the rate of increase of patient state- 
ments about the therapist. 

Table 12 shows, in the second column, 
the slope of the regression lines for the 
five cases on which data about the thera- 
pist’s behavior were available. The next 
column shows the number of times the 
therapist said something about the thera- 
peutic relationship over the number of 
times the patient said something related 
to the therapist. This ratio was used in 
order to control for the differences in 
the number of patient units between 
cases due to the variation in length of 
therapy. The correlation between this 
ratio and the slopes of the regression 
lines is negative but not reliable (r = 
—.67, df = 3). 

However, the therapist’s remarks were 
divided into two groups: active and pas- 
sive. The ratio of the active therapist 
remarks to the number of patient units 
showed a positive and ‘reliable correla- 
tion (r = .93, p <.o5) with the rate of 
increase of patient statements about the 
therapist. On the other hand, the ratio of 
the passive therapist remarks to the num- 
ber of patient units showed a reliable 
negative correlation (r = —.go, p <.05) 
with the rate of increase of the patient 
statements about the therapist. Further- 
more, a simpler measure consisting of the 
percentage of therapist remarks which 
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were active shows a highly reliable cor- 
relation (r = .g96, p <.o1) with the rate 
of increase measure. These data are all 
shown in Table 12. The results, then, 
tend to indicate that the rate of increase 
of patient statements about the therapist 
is positively related to the extent that the 
therapist responds to this material in an 
active rather than a passive way. 
However, the relationship between the 
therapist’s verbal activity and the rate of 
increase of the patient statements about 
the therapist is not restricted only to the 
way in which the therapist reacts to the 
therapist-relevant material. Rather, to 
some extent at least, the general verbal 
activity level of the therapist in dealing 
with all kinds of patient material— 
whether or not it is related to the thera- 
pist—seems to be related to the patient's 
verbal expression of feelings about the 
therapist. Thus, Table 13 shows the rate 
of increase of patient statements related 
to the therapist as a function of the way 
the therapist reacts to statements not re- 
lated to the therapist. The measures in 
Table 13 are analogous to those in Table 
12 but for patient statements not related 
to therapist and for therapist remarks 
about those statements. As can be seen 
in Table 13 the general pattern of results 
is similar to that in Table 12. The num- 
ber of times the therapist said something 


TABLE 12 


THE RATE OF INCREASE OF PATIENT STATEMENTS RELATED TO THE THERAPIST AS A FUNCTION 
OF THE WAY THE THERAPIST REACTED TO SUCH STATEMENTS 


Rate of 
Increase 
(slope) 


Total 
Ther. Rem. + 
Pt. Units 


Passive 
Ther. Rem. + 
Pt. Units 


Percent 


Ther. Rem. + Active 


Pt. Units 


1.50 
.82 
+44 
-14 


~ #6 
-14 .29 
-42 
+09 


Average .70 


= 

68 
.28 42 

31 
23 
: -53 16 
36 
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TABLE 13 


THE RATE OF INCREASE OF PATIENT STATEMENTS RELATED TO THE THERAPIST AS A FUNCTION 
OF THE WAY THE THERAPIST REACTED TO STATEMENTS BY THE PATIENT NOT 
RELATED, TO THE THERAPIST 


Rate of 
increase 
(slope) 


Total 
ther. rem. + 
pt. units 


Passive 
ther. rem. + 
pt. units 


Active 
ther. rem. + 


Percent 
pt. units 


active 


1.50 .24 
.82 .10 
-59 .28 
+42 
-14 -41 


-14 44 
.07 32 
12 
-40 5 
-39 6 


Average .70 .29 
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not related to the therapeutic relation- 
ship over the number of times the pa- 
tient said something not related to the 
therapist shows a negative but not reli- 
able correlation with the rate of increase 
of patient statements about the therapist 
(r = —.60, df = 3). 

The ratio of the number of active 
therapist remarks not related to the 
therapeutic relationship over the number 
of patient statements not related to the 
therapeutic relationship is positively and 
significantly related (r = .g2, p <.05) to 
the rate of increase of patient statements 
about the therapist. On the other hand, 
the ratio of passive therapist remarks to 
patient statements shows a negative but 
not significant correlation (r = —.36, not 
significant) with the rate of increase 
measure. Finally, the percentage of thera- 
pist remarks which were not about the 
therapeutic relationship which were ac- 
tive rather than passive showed a positive 
and significant correlation (r= .94, 
p <.05) with the rate of increase of pa- 
tient statements about the therapist. 

It is apparent from the above results 
that the rate of increase of patient state- 
ments about the therapist is a function 
of the degree to which the therapist is 
active rather than passive in responding 
to the patient statements in general and 
regardless of whether they are manifestly 


related to the therapist. However, the 
question naturally arises as to whether 
there are any differences in the way the 
therapist reacts to therapist-relevant and 
therapist-nonrelevant statements by the 
patient. The group average for each of 
the measures of the therapist behavior, 
in relation to patient statements related 
and patient statements not related to the 
therapist, are shown in Table 14. It can 
be seen that the therapists in the present 
sample responded significantly (p <.01) 
more to therapist-relevant than to thera- 
pist-nonrelevant material. This difference 
is due to a greater increase in active ther- 
apist remarks than to passive remarks. 
The active remarks showed a significant 
(p <.01) increase with therapist-relevant 
material while passive remarks do not. 
Furthermore, the percentage of therapist 
remarks which were active was signifi- 
cantly (p <.01) higher with therapist- 
relevant patient statements than with 
therapist-nonrelevant patient statements. 

A further question which arises is 
whether some difference between the 
way the therapists reacted to therapist- 
relevant and therapist-nonrelevant pa- 
tient statements could account for rate of 
increase of patient statements about the 
therapist. For this purpose, the differ- 
ences between the percentage of active 
therapist remarks for the therapist-relev- 
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TABLE 14 


THE DIFFERENCE BETWEEN THE WAY THE THERAPIST REACTED TO PATIENT STATEMENTS RELATED 
TO THE THERAPIST AND PATIENT STATEMENTS NOT RELATED TO THE THERAPIST 


Average for pat. 
statements not re- 
lated to therapist 


Measure 


Average for pat. 
statements related 
to therapist 


Increment 


Tot. ther. rem. +Pt. units 
Active ther. rem. +Pt. units 
Passive ther. rem. + Pt. units 
Per cent active 


ant and therapist-nonrelevant patient 
statements was correlated with the rate 
of increase of patient statements about 
the therapist. The correlation was posi- 
tive but not significant (r = .65, not sig- 
nificant). More cases are needed before 
a conclusion is drawn about this relation- 


ship. 
D. Discussion 


The results tend to show that the ver- 
bal expression cf the patient’s feelings in- 
creases during the course of the compara- 
tively short psychotherapy cases sampled. 
However, the results may be interpreted 
in many ways. They may mean that the 
patient is developing feelings about the 
therapist over a period of time in es- 
sentially the same way that people de- 
velop feelings about new acquaintances. 
On the other hand, it may be that a large 
part of the feelings are brought into the 
situation by the patient but their direct 
expression is inhibited by anxiety. At 
the very beginning of therapy they may 
be expressed only as displacements or 
may be entirely inhibited. Thus, for 
example, in Case D, the patient spent the 
first few hours in abstract intellectual 
discussion. In the content analysis this 
was scored as intellectual defense and 
properly so. But there was an undercur- 
rent in this intellectual discussion. The 
patient seemed to be telling the therapist, 
“Look, I’m clever and I’ve read a lot 
of books. I’m worthy of your interest and 


respect.” Later, the patient spent a good 
deal of time with physical complaints. 
Here he seemed to be saying, “I’m 
frightened and helpless. 1 need your 
help.” Naturally these interpretations of 
latent meaning are very tentative but 
they illustrate the possibility of displaced 
therapist-relevant material occurring at 
points where the curves in Figure 6 show 
no direct expression of feelings about the 
therapist. 

If the patient is expressing feelings 
about the therapist in a displaced way 
when he is talking about things not 
manifestly related to the therapist, it is 
then somewhat more understandable that 
the degree to which the therapist is active 
in his remarks about therapist-nonrele- 
vant patient statements has an effect on 
the rate of increase of patient statements 
about the therapist. 

The results then most probably mean 
that as therapy progresses the patient 
is more able to express feelings which 
to some extent he had all along. The pa- 
tients seemed to have anxiety about ex- 
pressing all aspects of the feelings in- 
volved: positive, anxious, and frustrated. 
The patient might anticipate rejection of 
his positive feelings, ridicule of his anx- 
ious feelings, and retaliation for his 
hostile feelings of frustration. The results 
can be interpreted in terms of Miller's 
theory of approach-avoidance conflict 
(14). In this connection, the irregularity 
in the increase of the curves in Figure 6 
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may represent conflict oscillation. The pa- 
tients appear to overextend themselves in 
their expressions of feelings about the 
therapist and then, as anxiety about this 
increases, they withdraw and talk about 
something else. This is akin to the nega- 
tive therapeutic effect (3). 

The fact that the activity of the thera- 
pist has an effect on the increase of the 
patient's expression of feelings about the 
therapist may mean several things. First, 
the therapist’s active remarks may be a 
way of indicating his interest in the area. 
Second, the active remarks of the thera- 
pist convey more information about the 
therapist’s emotional reactions to what 
the patient is talking about than do the 
passive remarks. Since the emotional re- 
actions of the therapist are primarily 
sympathetic and permissive, an increase 
in their communication should be en- 
couraging to the patient to express his 
feelings. 

A study of the relationship between 
the amount, quality, and rate of increase 
ol therapist-relevant verbal material and 
the achievement of therapeutic success 
is immediately suggested by the present 
findings. However, no generally accepted 
criteria for success were readily available 
for the present sample. 


V. SUMMARY AND CONCLUSIONS 


The purpose of this paper was to de- 
scribe the development, reliability, and 
validity of a method of studying psycho- 
therapy. The method was a content an- 
alysis of the verbal behavior of the pa- 
tient and the therapist. The categories 
of the content analysis were defined in 
terms of motivation and conflict, influ- 
enced by psychoanalytic and learning 
theories, and formulated in such a way 
as to be most relevant to an eventual 
understanding of the underlying emo- 
tional processes of psychotherapy. 
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A unit of patient verbal behavior was 
defined and shown to be reliable. A set 
of categories for the content of the pa- 
tient’s speech was developed from 
simpler categories used in several pre- 
liminary studies and shown to be reli- 
able. The categories included sex, affec- 
tion, dependence, and independence 
drives. Each drive was divided into posi- 
tive approach, anxiety, and frustration. 
Additional categories were also used. 

A set of categories for the remarks of 
the therapist was also developed and 
shown to be reliable. 

The use of the method in a case study 
was illustrated by an analysis of the ef- 
fects of subtle directiveness on the verbal 
behavior of a patient during the course 
of psychotherapy. It was found that the 
therapist mildly approved various sub- 
categories of independence and mildly 
disapproved independence anxiety, intel- 
lectual defenses, and various subcate- 
gories of sex. As would be expected from 
learning theory, the approved patient- 
content categories increased and the dis- 
approved patient-content categories de- 
creased throughout the course of psycho- 
therapy. 

The use of the method in determining 
a general relationship was illustrated by 
a study of the patient’s verbal expressions 
of feelings about the therapist. It was 
found that in a group of seven psycho- 
therapy cases the frequency of statements 
about the therapist increased reliably 
(p <.01) as therapy progressed. Expres- 
sion of all kinds of feelings tended to 
increase, rather than an increase in posi- 
tive and a decrease in negative feelings. 
It was also found that the rate of increase 
of the frequency of patient statements 
about the therapist was positively re- 
lated (p <.01) to the extent to which the 
therapist responds in an active rather 
than a passive way to patient material of 
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all kinds, whether or not it is related to 
the therapist. However, it was also found 
that the therapists in the sample were 
significantly (p <.01) more active in re- 
sponding to patient statements about the 
therapist than to patient statements not 
manifestly related to the therapist. These 
findings tend to fit in with what psycho- 
therapists have previously known in a 
general, qualitative way. 

There are some important limitations 
of the method. First of all, since it is 
based only on verbal behavior, some in- 
terpretation is needed to relate it to the 
underlying emotional processes. Second, 
in concentrating on motivation and con- 
flicts, the method has ignored various 
cognitive processes such as insight. Third, 
the method is a laborious one and im- 
poses limits on the size of samples that 
can be reasonably studied. 

The validity of the method cannot be 
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definitely established but only supported 
by its usefulness to date. The three case 
studies made with the aid of the method 
have all produced theoretically meaning- 
ful results. The first study (18) led to a 
hypothesis about displacement which was 
verified in the animal laboratory (21). 
The second study (20) yielded results 
which were in essential agreement with 
a detailed clinical analysis made of the 
same case (4). The last case study (Sec- 
tion III) fits in with expectations of 
learning theory (3, 11) concerning the 
effects of approval and disapproval on 
human behavior. The general relation- 
ships reported in Section IV seem theo- 
retically meaningful, fruitful of further 
hypotheses, and in general agreement 
with clinical experience. Therefore, it is 
concluded that the method appears to be 
of some use and to have some validity. 


APPENDIX A 


MINOR STUDIES ON SUBTLE DIRECTIVENESS IN PSYCHOTHERAPY 


I. A group judgment of selected therapist re- 
marks as approval and disapproval in the case 
of Herbert Bryan 


A special study was done in order to determine 
the degree to which a group of psychologically 
sophisticated individuals would agree on the 
approval or disapproval value of selected thera- 
pist remarks which seemed clear-cut to the 
writer. Since this study is essentially an experi- 
mental situation involving stimuli of hypothe- 
sized value rather than a reliability study of a 
content-analysis system, it was not presented in 
the main body of the study which is devoted to 
the content analysis proper. 

The writer went through the case of Herbert 
Bryan (See Section III) and selected the 19 in- 
stances of approval which seemed most clear to 
him. He then selected clear instances of disap- 
proval, which totaled 15. The 34 responses were 
marked off with enough patient context to make 
them understandable and then mimeographed in 
a random order in a little booklet. Twenty senior 
graduate students and young Ph.D.’s in clinical 
psychology were asked to judge what the thera- 
pist said as approving, disapproving, or neither 
in terms of the following definitions: 


Approving: Any approval or agreement 
mixed with approval for: attitudes held by 
the patient; decisions to adopt attitudes; ways 
of behaving or talking in the therapy; past, 
present or future actions outside of the 
therapy. 

Disapproving: Any slight disapproval, dis- 
agreement, criticism or argument with: the 
patient’s attitudes; decisions to adopt an atti- 
tude; ways of behaving or talking in therapy; 
past, present or future actions outside of 
therapy. Also any indication that the therapist 
doesn’t like the way the patient is discussing 
his problems or the language he uses in dis- 
cussing his problems. Any time the therapist 
disagrees with the way in which the patient 
sees his problems and either offers a new defi- 
nition of what’s wrong or adds to the patient's 
interpretation. (This is to be scored “D” even 
if the scorer tends to agree with the therapist's 
view rather than the patient’s.) 

Neither: Anything to which the approving 
or disapproving do not apply. 

The results are shown in Table 15. The group 
reliably judged 15 of the 19 approvals, and 10 
of the 15 disapprovals, in the correct categories. 
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TABLE 15 


THE AGREEMENT IN JUDGING 34 SELECTED THER- 
APIST’S REMARKS AS APPROVAL AND DiIs- 
APPROVAL BY TWENTY CLINICAL 
PSYCHOLOGISTS 


Judgments of 20 Clinical 
Psychologists 


Judgment 
of experi- No 
menter Judged Judged Judged  agree- 
(Murray) ap- disap- neither* ment 
proval*  proval* among 
judges 


Approvals 15 ° ° 4 
Disapprovals 0 10 I 4 


* The number in the body of the table for the 
first three columns is the number of therapist's re- 
marks that a reliably large part of the group 
(p<.o2) judged as approval, disapproval, or 
neither. 


No approval was mistaken for a disapproval, and 
no disapproval was judged as approval. 

The results of this study tend to support the 
finding in Section III that the case of Herbert 
Bryan contains remarks by the therapist that 
have mild approval or disapproval value. ‘The 
study, of course, offers no further support for 
the other findings in Section III that the ap- 
proval and disapproval formed a pattern, and 
were related to changes in the verbal behavior of 
the patient. 


Il. An opinion study of the subtle directiveness 
in one psychotherapy hour in the case of 
Herbert Bryan 


The data presented in Section III support the 
view that the therapist influenced the patient's 
decision to be independent. However, the judg- 
ments of short segments of the therapist’s be- 
havior may have produced a distorted picture. 
After all, the patient responds to a total impres- 
sion. In addition, the judgments of clinical 
psychologists may not be comparable to those 
of Mr. Bryan. Therefore, a general impression 
of the directiveness of one hour was gotten 
from a heterogeneous group of go intelligent but 
relatively naive people. The people were under- 
graduates at Yale College and New Haven State 
Teachers College, relatively untrained Army 
psychology technicians, and Yale graduate stu- 
dents. The hour chosen was the sixth, the one 
just before the major change. The people were 
asked to read a mimeographed copy of Hour 6 
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and answer four simple questions. 

The first question was as follows: “In this psy- 
chotherapy hour the patient is discussing a 
strong conflict. He is trying to make a difficult 
choice. This choice is between a)———and b) 
———.” The purpose of this question was to see 
if the subject understood the basic conflict in the 
hour. All subjects answered quite adequately in 
their own terms. 

The second question was: “Do you feel the 
therapist basically: a) wants the patient to make 
one choice rather than another, or b) is com- 
pletely neutral and doesn’t care which choice the 
patient makes?” The purpose of this question 
and the next was to allow the subject to answer 
that he felt the therapist had an opinion, pos- 
sibly just because he was a therapist, but still 
to answer “no” to a later question about the 
therapist acting on his opinion. Nineteen of the 
20 subjects answered that the therapist basically 
wanted the patient to make one choice rather 
than another (p < .0001). 

The third question was: “If you feel the thera- 
pist wants the patient to make a choice, which 
direction do you think the therapist wants the 
patient to take?” All of the 19 people left after 
question g gave an answer which indicated, in 
their own words, that the therapist wanted the 
patient to be independent (p < .0001). To some 
extent at least, the answers to the two questions 
above are probably due to the expectations that 
people have of therapists. There is ample evi- 
dence that Mr. Bryan also had these expecta- 
tions. However, the answers to the next question 
will show that Mr. Bryan was not influenced 
by his expectations alone. 

Question 4 reads as follows: “Do you feel that 
the therapist gets this across: a) very obviously 
and strongly, b) in a subtle and indirect way, or 
c) doesn’t get it across at all.” Two people felt 
that the therapist got it across very obviously and 
strongly, 16 people felt he got it across in a 
subtle and indirect way, and only one person 
felt he didn’t get it across. Therefore, the thera- 
pist got across his preference for independence 
(p< .0001) and did it in a_ subtle way 
(p < .01) according to the opinions of this group 
of people. 

The results tend to support the finding in 
Section III that the therapist employed subtle 
directive techniques which influenced the verbal 
behavior of the patient. The agreement between 
the common sense judgments in this study and 
the results of the content analysis in Section III 
lend some support to the validity of the con- 
tent-analysis system, 
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APPENDIX B 


INSTRUCTIONS FOR SCORING PATIENT UNITS 


Simple sentences. The simple sentence is the 
basic unit of scoring. In its purest form the 
sentence contains a subject and predicate—the 
predicate usually contains a verb and an object. 
Adjectives and adverbs may be present. The 
simple sentence may not make complete sense all 
by itself since the meaning of pronouns, allu- 
sions, etc., may gain their meaning from the 
context. But with this help the simple sentence 
must contain a complete idea. Some examples 
are: 

a. “The telephone wires were cut.” 

b. “It’s been in my conscience.” 

c. “But I couldn’t stand it.” 

d. “I’m terribly upset about this experience 

last night.” 

Incomplete sentences. 1. A statement may be 
incomplete in itself and yet not be part of a 
previous or following statement. If the missing 
part is strongly implied then it is counted as a 
regular unit, e.g., 

a. “Parked in 


the driveway.” (Here it is 


implied that “The car was parked in the 
driveway.”’) 

. “A young bride who is madly in love with 
her husband.” (Here it is implied that, 
“She is a young bride. . . .”) 

c. “Very exciting over there.” (“It was very. 


is implied.) 
II. But where the phrase is patently incom- 
plete and never followed up it is ignored, e.g., 
a.“And ...ah... they to... she, etc.” 
(Here the “they to” leads to nothing.) 
b. “It must of ...1... 1 can't, etc.” (Here 
the “It must of” leads to nothing.) 
Slightly complex sentences. These are sentences 
with introductory phrases, dependent clauses, ad- 
jectival phrases, immediately preceding or follow- 
ing explicatives, etc. Some examples are: 
a. “I lied to you last week, last Tuesday.” 
b. “I've been very dishonorable, many times.” 
c.“. . . or how you'd feel about all this— 
these things I told you.” 
. “But I still have that terrible guilt feeling 
that I can’t do these things.” 
. “I don’t remember anything about it—only 
that I had this nightmare.” 
“...a young bride of three months who is 
madly in love with her husband.” 
. “I said it happens but it isn’t a good idea to 
follow through on it.” 
. “A close friend of mine, a very close friend, 
just died.” 
i. “Oh! Oh! But its, etc.” 
j. “God! I can’t believe it.” 
Relational sentences. These are sentences con- 


taining two parts which are related in some way 
such as showing cause and effect, explanation, 
definitions, etc. A simple example is: “I just had 
to tell you that I lied because I’m not honorable 
at all.” The cause and effect may be logical or 
not and may be vague or specific. These sen- 
tences are scored as one unit. The commonest 
words used in these sentences are: because, since, 
if... then, so, in spite of, therefore, when, before, 
after, etc. However, these words are only guides 
since they may be used in other ways and other 
words may be used to relate the two parts. Fur- 
thermore, the relation may be implied (strongly) 
without a specific relational word; e.g., “I mean I 
figured Alice is growing up and she needs a 
respectable mother.” 

Conjunctival sentences. These are sentences 
which have several phrases joined together such 
as: “Well he was kind and sweet.” They usually 
contain a conjunction such as: and, or, either... 
or, etc. But two types can be distinguished. In 
the first type a number of nouns, or verbs, or 
objects may be joined but the rest of the sen- 
tence is unitary; e.g., 

a. “Mother and Father treated me like a little 

girl.” 

b. “I don’t know what's going to become of my 

husband and children.” 

c. “She was always nagging and shouting at 

me.” 
These sentences are scored as one unit. On the 
other hand the conjunction may combine two 
sentences complete or nearly complete in them- 
selves. There may be separate ideas or the same 
idea repeated. These sentences are scored as 
two or more units. However, a verb and a subject 
must be present in each section of the sentence 
to be scored as a separate unit; e.g., 
a. “I didn’t know what you’d think/or what 
you'd say/or how you'd feel about all this 
. these things I told you/.” (In this case 
three units share the same final ending.) 
b. “We went visiting the other afternoon /and 
I had a couple of drinks/.” 

c. “Bud is sweet/and he’s kind/and he has a 

good disposition/.” 

d. “But it never comes up/or does it?/” 

Sentences related to the therapist’s remarks. 
I. A thought unit may be interrupted by the 
therapist but finished afterward. The stroke is 
put at the end of the continuation; e.g., 

P: “- - - -/They took her car as a get-away. 

T: “Oh, I see. MmmHmm.” 

However, the continuation must be a definite 
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part of the first line. If a new thought is in- 
troduced, if the first thought is repeated, or if 
the first thought is modified with respect to what 
the therapist says, then it is scored separately. 
If in this case the first line is left incomplete it 
is ignored. 

Il. Thought units which are incomplete in 
themselves but which serve as agreement, dis- 
agreement, etc., with a therapist statement are 
counted as units; e.g., 

a. T: “I think that it’s very important that 
you understand why you weren't able 
to tell me that last week. You see?” 

P: “Mmmm /Oh, I was afraid to.? I... .” 
. T: “That's what you were dreaming.” 

P: “Evidently./” 

T: “Mmmhmm. And then what happened?” 
P: “I dunno/It’s a long. .. .” 
. T: “But you know he isn’t... .” 

P: “Yes, but / still I can’t... .” 

(This is a special case. Wherever there 


is a “Yes, but,” “Still,” “Yes, however,” 
etc., reaction after a therapist remark it 
is scored as a unit.) 

III. Sometimes the patient will finish a sen- 
tence for the therapist. In this case the whole 
idea is scored as a patient unit; e.g., 

a. T: “- - - - Understanding it now... . 

P: “Will make a change./” 
b. T: “- - - - for something which just... .” 
P: “happened./” 

Questions and quotes. All questions are to be 
scored as a unit even if they are tacked on the 
end of a sentence; e.g., 

a. “Because its gone on too long./ Hasn’t it?/” 
The introduction to a question or quote is 
scored along with it and not separately; 

b. “And I said ‘I don’t know’.”’/ 

Two sentences within a quote are to be scored 
separately as other sentences are; 

c. “And I said ‘I don’t know.’/ ‘I just have a 
guilt feeling’.’’/ 


APPENDIX C 


INSTRUCTIONS FOR SCORING PATIENT CONTENT 


Disturbances of free association. 

a. Asking questions, seeking directions, enter- 
ing into bilateral discussion with therapist; 
eg., “Should I just try to remember my 
dreams or jot them down?” “What do you 
think I should talk about now?” 

. Not following the rule of free association; 
enlisting therapist in this; e.g., “I can’t talk 
about my father.” “You don’t want me to 
relate trivial matters, do you?” “That's sort 
of personal.” 

’. Expressing difficulty in talking or thinking 
of things to say; e.g., “My mind is a com- 
plete blank.” “We've talked about every- 
thing now.” 

d. Other. 

Agreement with therapist remarks. 

a. “Mmmhumm,” “yes,” “surely, 

b. “I agree,” “I think so,” etc. 

c. “No”—if the therapist’s remarks required 
“no” for agreement; e.g., T: “But you don’t 
want that!” P: “No.” 

d. Other. 


Disagreement with therapist remarks. 

a. “No, I disagree,” “I don’t think so,” etc. 

b. “Yes, but... I agree, but... ;” 
“that’s so, but... ;” etc. 

c. “Yes,” if the therapist’s remarks required 
“No” for agreement; e.g., T: “But you don’t 
want that!” P: “Yes, I do.” 

d. Alarm or startle reactions: “Oh my!” “Good- 
ness!” 


etc. 


e. “I don’t know.” “I’m not sure,” etc. 
f. Other. 
Intellectual discussion. Includes discussion of 
abstract psychological theory, philosophy, art, 
literature, science, politics, etc. (except where the 
activity is a professional one. ) 
a. “Psychologically and philosophically one 
could attribute it to conditioning.” 

. “Iam fond of the Existential outlook.” 

. “I'm writing a philosophical novel.” 

. “Our values are our private absolutes.” 

. “Human behavior is subject to variation 
anyway.” 

. “There are two kinds of will.” 

. “Toynbee discusses that problem rather 
well.” 

. “But the cultural anthropologists have seri- 
ously undermined Freudian theory.” 

i. “I must tell you about the concert I went 
to last night.” 

j. “I'm trying to reconcile scientific determin- 
ism with my own inner feeling of free 
will.” 

Generalized anxiety. Includes all psychologi- 
cal and somatic expressions of anxiety which are 
not related to a drive nor related to any specific 
person or object; general “free floating” anxiety 
and guilt. 

a. “I feel panicky about the thought of death.” 

b. “I tremble and then it would ease off, then 
I'd start again .. . in waves.” 

c. “I feel tense as if there’s some force inside 
of me trying to get out.” 
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. “I have frightening suicidal thoughts.” 

. “Life is meaningless .. . why are we here?” 

. “I feel like there’s an axe pressing down 

on my dynamo.” 

x. “I feel like a coward.” 

h. “I don’t know how I've lived so long and 

learned so little.” 

i. “I dream of monsters trying to catch me and 

eat me up.” 

Sex. Includes all statements referring to the 
positive or approach component of the sexual 
drive; direct expression of sexual needs and 
wishes, description of sexual attraction and 
arousal, sexual activity not mixed with fear or 
guilt, planning for sexual satisfaction, courtship 
and dating among unmarried people where the 
erotic element is present but institutionalized, 
description of homosexual feelings and other 
perversions, descriptions of masturbation, dis- 
cussion of normal sex education. 

a. “I talked over my affair with my father.” 

b. “He wanted to have sexual relations with 

me.” 
. “I've had funny feelings in my legs since 
coming to you.” 

. “I used to like to cling to my brother.” 

. “I have dreams about having intercourse 
with a faceless woman.” 

. “I liked Jewish men because I thought they 

were sensuous.” 
. “I menstruated freely and easily.” 
. “I like to watch strip teasers.” 

i. “I look on myself as a sexual artist.” 

j. “I value sex highly.” 

Sex anxiety. Includes expressions of fear, anx- 
iety, or guilt about sex; nervousness, irrational 
fears, phobias, compulsions, depression, hopeless- 
ness, confusion, helplessness, conflict, tension, 
blocking; avoidance behavior, denial of a sex 
drive, negative attitude toward sex, rationalizing 
one’s behavior, deprecating self; feelings of in- 


adequacy, somatic symptoms, impotence, frigidity. 


a. “I'm frightened by my sexual feelings 
toward you.” 

b. “I could only get aroused during inter- 
course by pretending I was completely 
paralyzed.” 

. “T was nervous and disgusted when my 
brother made advances to me.” 

. “I felt awful when I performed fellatio on 
him.” 

. “I was afraid someone would discover us.” 

. “I only felt aroused when I found out he 
was impotent.” 

. “I worry about functioning adequately.” 

. “My diaphragm is the next to the smallest 
size and I felt I was underdeveloped.” 

i. “My breasts didn’t grow until after all my 
girl friends had fully developed.” 

j. “I nearly threw up when I started having 
intercourse with her.” 


Sex frustration. Includes hate, anger, resent- 
ment, criticism, or complaint about the frustra- 
tion of the sex drive; description of behavior 
designed to, or expression of desire to, destroy, 
hurt, attack verbally or physically, disparage, 
humiliate, domineer, or deprecate in any way; 
frustrating another person, withholding the sym- 
bols of affection, making someone uncomfortable. 

a. “My husband has premature ejaculation.” 

b. “He's mechanical . . . no tenderness.” 

c. “My mother punished me for talking about 
sex to a friend of mine when I was a boy.” 

. “On our wedding night he sat up all 
night talking to the cab driver.” 

e. “He was constantly experimenting.” 

f. “You won't do anything here in therapy.” 

g. “My mother wouldn't let me feel proud of 
my first menstruation.” 

h. “He forced me to do fellatio.” 

i. “I have intense feelings of jealousy.” 

j. “Intercourse just isn’t readily available in 
the environment.” 

Affection. Includes direct expression of needs 
for love and affectionate behavior; needs for and 
appreciation of affection, friendship, acceptance, 
understanding; feeling of loving, giving affec- 
tion, etc., or having entered into an affectionate 
relationship; doing something positive for or 
with a person; holding someone in high regard, 
respecting, appreciating etc. 

a. “I like him, he’s such a fine person.” 

b. “I like to please my mother.” 

c. “I have a euphoria before my interview.” 

d. “My little son helped me on the farm 
today.” 

e. “I went out with him because I could talk 
to him the way I used to with my father.” 

f. “I feel at ease talking to you.” 

g. “I want to settle down and marry.” 

h. “I'm lonely . . . I want someone to love.” 

i. “He’s intelligent, good-looking, and kind.” 

j. “She’s a wonderful gal.” 

Affection anxiety. As in sexual anxiety but 
related to affection. 

a. “I'm afraid to fall in love.” 

b. “I don’t want to become emotionally in- 
volved with a girl until I finish the treat- 
ment.” 

- “I'm usually not close to my son.” 

. “After that experience I don’t feel like 
dating any more.” 

. “I never did love my husband.” 

. “I get upset and feel nauseous when I try 
to talk to people at a party.” 

. “I’m going to stop my husband from trying 
to see me.” 

. “I'm going to stop dating her.” 
“A really decent man wouldn't find me very 
interesting.” 

j. “You don’t love me because I’m so stupid 
and neurotic.” 
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Affection frustration. As in sex frustration but 

related to affection. 

a. ‘My parents never gave me any love or 
attention.” 

b. “I want to marry you and you keep telling 
me about other men.” 

c. “I always felt my brother was the favored 
one.” 

d. “Women just use love to sugar-coat their 
sexual feeling.” 

e. “My wife wouldn't stay with me during 
the vacation.” 

f. “We didn’t feel accepted socially.” 

g. “He insisted on having sex while that poor 
dog of mine lay next to the bed dying.” 

h. “She won’t show me any love.” 

i. “He never gave me any presents.” 

j. “There aren’t any eligible men around.” 

Dependence. Includes expressions of needs to 

depend on someone, let someone else take the 
initiative, to be told what to do, to be helped, 
to be cured by an outside agent; description of 
dependent behavior or nurturant actions by 
others to self; being appreciative of being taken 
care of by another; making personal security 
contingent on another. 

a. “I liked being cared for by my father when 
I was so sick.” 

b. “I have a dentist I like and trust.” 

c. “I like to have someone I can confide in and 
get advice from.” 

d. “I’m hoping that after I talk myself out 
you're going to pull a rabbit out of the 
hat.” 

. “I need someone to help me out of a bad 
situation.” 

. “Grandmother used to send me money.” 

. “I want to marry a man who is superior 
to me.” 

. “I'm looking for a magic key to my prob- 
lems.” 

i. “You are my superior in emotion changing 
technique.” 

j. “I need help.” 

Dependence anxiety. As in sex anxiety but 

related to dependence. 

a. “I'm afraid of people stronger than me.” 

b. “I don’t like to accept any of my husband's 
money.” 

. “I'm afraid of being in a situation when I 
can’t move—when I'm at the mercy of other 
people.” 

. “I know that people can make me do things 
if they’re smart enough.” 

. “I was afraid to start therapy.” 

. “I get nervous when I date a really strong 
man.” 

g. “I don’t trust dentists.” 

h. “I don’t like to accept charity.” 

i. “I would be frightened by a domineering 
wife.” 


j. “I couldn’t let on that I needed her.” 

Dependence frustration. As in sex frustration 
but related to dependence. 

a. “It seems that only lonely, clinging people 

like my husband love me.” 
. “My mother wouldn't send me the money 
when I needed it.” 

. “You keep throwing me on my own.” 

. “She won't help me with the work.” 
. “My parents wouldn’t send me to school.” 
. “I need to be taken care of and he’s too 
weak to do it.” 

. “You can’t confide in anyone in the family 
—they’re all independent.” 

. “She used to tell me all her problems but 
I wanted to tell her mine.” 

i. “I’m discouraged—I don’t think this is doing 

me any good. 

j. “My wife just doesn’t do things for me the 

way my mother used to.” 

Independence and self-assertion. Includes ex- 
pression of needs to be independent, adult, ma- 
ture, assertive, ambitious, competitive; standing 
up for one’s rights, defending against attack, 
saying “no” when one has to, expressing an 
opinion or warranted criticism; descriptions of 
behavior or plans to be independent, etc. 

a. “I pick out my own clothes now.” 

b. “I have more ambition lately.” 

c. “I love work that requires thinking and 

responsibility.” 

d. “I’m going to arrange it so that mother 

can’t move in with me.” 

e. “I told him that’s how much work I did 

and that he’d have to pay for it.” 
. “I’m successful at everything when I'm feel- 
ing well.” 

. “You can only achieve growth by meeting 
new situations.” 

. “I can relax when I’m playing cards with 
her now.” 

i. “I have to accept responsibility for my 

neurosis.” 

j. “I enjoy getting people to cooperate with 

me.” 

Independence anxiety. As in sex anxiety but 
related to independence. 

a. “I used to be afraid to assert myself to my 

mother.” 

b. “This new job is more uncertain than the 

old.” 

c. “I’m blocked in every field of effort.” 

d. “I feel guilty about doing something that 

I like to do—like building ship models.” 

e. “I get anxious when having a philosophical 

argument.” 
f. “My stomach gets upset when business is 
bad.” 

. “I'm no good—I can’t cope with a job.” 

. “I felt I couldn't live up to their expecta- 
tions.” 
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i. “I'm just lazy.” 

j. “I get tired very easily.” 

Independence frustration. As in sex frustra 
tion but related to independence. " 

a. “She picked out all my clothes.” 

b. “I had to be home by 11 o'clock.” 

c. “He won't let other people talk—he keeps 

interrupting them.” 

. “Jobs are hard for women to get.” 

. “She reads my diary and mail.” 

. “I don’t like to be bossed.” 

. “IT don’t like the fact that you run the 

hours—that you know more than I do.” 
. “She controlled the whole situation and I 
didn’t like being at her beck and call.” 
i. “He won't let me express my opinions.” 
j. “I hate my mother for the way she domi- 
nated us.” 

Unspecified anxiety. As in sex anxiety but re- 

lated to no apparent drive. To be distinguished 


from generalized anxiety by the fact that it is 
related to some specific person or thing. 
a. “My brother used to frighten me when I was 
a child.” 
b. “My husband does frightening things like 
once he cut off the head of my marionette.” 
c. “I wake up in a cold sweat after dreaming 
about my father.” 
d. “My heart beats fast and I tremble when [ 
come in here.” 
e. “I don’t feel worthy of taking up your time.” 
Unspecified frustration. As in sex frustration 
but related to no apparent drive. 
a. “I just hate her.” 
b. “I noticed what a big nose you have.” 
c. “I get irritated every time I see my brother.” 
d. “He was a clumsy dancer.” 
e. “When he came home drunk I hit him on 
the head.” 


APPENDIX D 


INSTRUCTIONS FOR SCORING THERAPIST CONTENT 


Instruction to free-associate. Whenever the 
therapist explains the rule of free association, 
the need for it, the benefits to be gained from 
following it, or directly insists on it. Whenever 
the therapist asks the patient to tell him what 
he was thinking about during a pause. 

a. “You must speak out your thoughts.” 

b. “Even if it disturbs you, you must strive to 

say anything that comes into your mind.” 

c. “If you say everything that comes into your 

mind we can find out what’s bothering you 
and help you.” 

d. “What were you just thinking about?” 

Labels. Wherever the therapist tells the patient 
what it was he was feeling or doing. Wherever 
the therapist points to the patient’s own feelings 
or behavior in a situation where the patient has 
only talked about the other person. Most causal 
statements are labels. 

a. “You must have felt excited when he did 

that.” 

b. “That must have been a frightening ex- 

perience.” 

c. “Or perhaps you feel that way whenever you 

have to depend on someone.” 

d. “Couldn't it be—that it was a matter of your 

letting her do it, rather than her doing it?” 

In scoring labeling remarks by the therapist, the 
symbol Lab. should be followed by the general 
nature of the labeling. The examples above 
would be scored: 

Lab.—sexual excitement—brother 

Lab.—fear—automobile crash 

Lab.—dependency—general 

Lab.—rejecting daughter 


Part of the general nature of the label is found 
in the patient content, e.g., the fact that “he” in 
the first example refers to the patient’s brother. 

Discrimination. Wherever the therapist points 
out a difference between two situations, feelings 
or behavior patterns. The main instances are 
where he points out the difference between past 
and present conditions, and the difference be- 
tween what the patient expects from people and 
what they are like. 

a. “When you were a child your mother didn't 
let you think for yourself but now you're 
an adult and you're expected to be inde- 
pendent and think for yourself.” 

b. “Well, not all men are like that.” 

c. “Most people don’t find sex as nauseating 
as you do.” 

Again the two things discriminated are written 
next to the symbol. For those above: 

Disc.—child and adult—independence 

Disc.—good and bad men-—selfish 

Disc.—patient and other people—sex as nau- 
seating 

Similarities. Wherever the therapist points out 
two situations, feelings, etc., which are similar 
or have a common element. It may be done in 
the form of a question or leading statement. 

a. “That’s the same way you felt about your 

first husband.” 

b. “Isn’t that the same way you felt when you 
were a child?” 

c. “Isn't this the way you react to all men?” 
Again the two situations which are related are 
noted. Above: 

Sim.—First and second husbands 
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Sim.—Child and adult 
Sim.—Reaction to all men 

Strong approvals. Any form of strong approval 
for the way the patient has just been speaking or 
for an outside action that the patient has de- 
scribed. Strong agreement, encouragement, re- 
assurance, and explicit permissiveness. 

a. “That sounds excellent.” 

b. “I appreciate how tough it was for you to 

say that.” 

c. “You're certainly making progress now.” 

Disapprovals. Means some indication that the 
therapist doesn’t want the patient to continue 
talking about what he has just been talking 
about, or the way in which he was talking about 
it. Any indication that the therapist does not feel 
the topic is important, interesting, or acceptable. 
Any surprise, alarm, anxiety, or disturbance on 
the part of the therapist. Any of the typical social 
punishments such as: belittling the patient or his 
statements: holding up an example in contrast to 
what the patient says; replacing a patient’s in- 
terpretation with the therapist’s own and dif- 
ferent one in such a way as to reject what the 
patient has said. Giving a negative evaluation to 
something the patient says. 

a. “Yes, but this may not be the most im- 

portant problem facing you.” 

b. “You talk on such an abstract level that it’s 
difficult to understand what it means 
you.” 

. “Do you really do that?” 

. “You really can’t mean that.” 
. “We aways get back to your mother.” 

. “That may be, but don’t you think it's 
rather your hostile feelings?” 

. “That's not getting you any place.” 

h. “You can’t do both.” 

Demands, Is an attempt to elicit verbalization 
about a topic that hasn’t immediately preceded 
the demand, That is, a unit is scored as a 
demand only if it is an attempt to bring up a new 
topic or one which has been dropped by the 
patient. In order to qualify as “new” a topic 
must not have been mentioned by the patient in 
the ten patient statements just previous to the 
therapist’s remark, 

a. “You were telling me earlier about your 

mother, what about her?” 
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b. “I wonder if you would tell me something 

about your sex life.” 

. “I was thinking about how you went about 
getting a job last month. How did you feel 
about that?” 

Directions. This is wherever the therapist tells 
the patient what to do (other than to free- 
associate). Also any statements of opinion about 
general questions. 

a. “Perhaps if you tried to be nice to him it 

would help.” 

b. “Don’t you think you should keep trying?” 

c. “I think there are greater satisfactions in 

marriage.” 

Mild probes. This category is for instances 
where the therapist is encouraging what the pa- 
tient is talking about but where he asks the 
patient to continue talking about the topic, asks 
for elaboration of one point, or asks for informa- 
tion directly related to what the patient is talking 
about. It will also include confession of ignorance 
or lack of understanding on the part of the 
therapist. The typical “tell me more” remark. 

. “That seems strange, doesn’t it?” 

b. “How could that be?” 

c. “Who would she belong to then?” 

d. “What do you mean by ‘passion’?” 

e. “Would you tell me a little more about 

that?” 
“I don’t completely follow that.” 

. “Why did you do that?” 

. “It sounds like there’s more of a_ story 
behind that.” 

Mild approvals. This category is for instances 
where the therapist shows a minimum response 
which is generally positive. 

a. “Yes,” 

ace.” 

c. “IT understand.” 

“Mm.” This category is for instances when the 
therapist grunts or verbally nods. It includes 
“Mm” and “MmMm_” but includes no words, 

Irrelevant. All general opening and closing re- 
marks; discussion of technical details in therapy 
such as “O.K. Tuesday at 10”; other irrelevant 
remarks. In addition, any response on the part 
of the therapist which cannot be put in other 
categories. Any unscorable self-phrases or mum- 
bling. 


EDWARD J. MURRAY 
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